A variational principle for the Pareto power law 
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A mechanism is proposed for the appearance of power law distributions in various complex sys- 
tems. It is shown that in a conservative mechanical system composed of subsystems with different 
numbers of degrees of freedom a robust power-law tail can appear in the equilibrium distribution of 
energy as a result of certain superpositions of the canonical equilibrium energy densities of the sub- 
systems. The derivation only uses a variational principle based on the Boltzmann entropy, without 
assumptions outside the framework of canonical equilibrium statistical mechanics. Two examples 
are discussed, free diffusion on a complex network and a kinetic model of wealth exchange. The 
mechanism is illustrated in the general case through an exactly solvable mechanical model of a 
dimensionally heterogeneous system. 
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Introduction. The study of plausible mechanisms re- 
sponsible for the appearance of power law distributions, 
observed so frequently in Nature, represents an active 
research field. Power laws were first met in fields far 
from traditional physics, e.g. Pareto's power law of in- 
come distribution in economics and the Zipf law for the 
occurrence rate of words in linguistics 1] , suggesting the 
existence of general characteristics for the underlying dy- 
namics. Power law distributions are also found in systems 
out of equilibrium, e.g. with avalanche dynamics [2| or 
in multiplicative stochastic processes Q. Their peculiar 
character, strikingly different respect to the exponential 
tails of canonical distributions predicted by equilibrium 
statistical mechanics, challenges our intuition. 

A first-principles derivation of equilibrium distribu- 
tions with a power law tail is possible at the price of ad- 
ditional hypotheses on the foundations of canonical equi- 
librium theory, e.g. in non-extensive generalizations of 
the Boltzmann entropy 0], or modifying the basic form 
of the Gibbs distribution Power laws are also ob- 
tained within the framework of superstatistics Q , if some 
parameter, typically the temperature, is considered as a 
random variable. 

The present paper introduces a novel mechanism based 
on the heterogeneity of the system dimensionality, char- 
acterizing systems composed of subsystems with different 
numbers N of degrees of freedom distributed according 
to a dimension density P(N). The derivation uses a vari- 
ational approach based on the Boltzmann entropy, with 
no additional assumptions outside canonical statistical 
mechanics. A robust power law tail appears due to the 
superposition of the canonical equilibrium distributions 
of subsystems with high dimensions N 3> 1. 

The phenomenon investigated here resembles how 



in the gene regulation network model of Balcan and 
Erzan [7fl a scale-free network results from the superposi- 
tion of Poissonian out-degree distributions. Also, a high 
phase space dimensionality is known to play a role in the 
anomalous dynamics of some spin-glass models [§]. 

The mechanism proposed here for the generation of 
power law tails is best illustrated for systems which can 
be clearly defined as dimensionally heterogeneous, on the 
basis of a mechanical analogy or a geometrical interpre- 
tation. For this reason, two explicit examples of such sys- 
tems are presented. Then the mechanism is formalized 
in terms of a simple yet general dimensionally heteroge- 
neous mechanical model. 

Diffusion on networks. As a first example we com- 
pare a free diffusion process on a homogeneous network 
and that on a scale-free network. We first consider a 
homogeneous lattice of M sites, in which each site i 
(i = 1 , . . . , M) is connected to the same number fc, = k 
of first neighbors. Such a lattice is an example of a di- 
mensionally homogeneous network providing a discrete 
representation of a A^-dimensional space. In the case of 
the square lattice structure, the dimension N is related 
to the degree k as N = k/2. An unbiased uniform diffu- 
sion process of X walkers hopping between the M sites 
of the lattice relaxes toward a uniform load distribution 
fix) — const, with the same average load at each node 
i given by Xj, — X/M . On the other hand, a hetero- 
geneous network with degree distribution g(k) cannot be 
given a straightforward geometrical interpretation and in 
general represents a space with a highly complex topol- 
ogy. In particular, no unique dimension can be assigned, 
so that it can be regarded as a dimensionally heteroge- 
neous space. One can estimate a local dimensionality 
from the connectivity, in analogy with the homogeneous 
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square lattice, by introducing for each node i the local 
dimension Ni = ki/2 [lfj. At equilibrium, free diffu- 
sion of X walkers on such a network is known to re- 
lax to an average load proportional to the degree 
Xi — xki, where the average flux per link and direction 
x is fixed by normalization, x — X/K, with X = J\ x i 
and K = J2j kj ■ It follows from probability conserva- 
tion that the load distribution at equilibrium is directly 
determined by the degree distribution, 



f(x) = g(k)dk/dx = g(x/x)/x . 



(1) 



In the important case of a scale-free network with g(k^> 
1) ~ l/k p , one has a power law tail in the load distri- 
bution, f{x) r~j l/x p , with the same exponent p. A close 
relation between degree distribution and equilibrium den- 
sity, analogous to Eq. ([T]) valid for the case of free diffu- 
sion, can be expected for any quantity x diffusing through 
a network. For instance, in the case of the Zipf law, such 
a relations is known to hold approximately. In this case 
written language is regarded as a random walk across the 
complex network with nodes given by words and links be- 
tween words which are neighbors in a text 11 1 . 

Kinetic exchange models. A second example of dimen- 
sionally heterogeneous system is suggested by kinetic ex- 
change models of wealth (KWEM) [l3|. In KWEMs, M 
agents exchange wealth through pair-wise interactions. 
At each time step two agents i,j are extracted randomly 
and their wealths Xi , Xj updated depending on the saving 
parameters Xj, Xj , representing the minimum fractions of 
wealth saved [13j ]. 

x\ = XiXi + e[(l - X i )x l + (1 - Xj)Xj] , 

4 = X jXj - (1 - c)[(l - X i )x l + (1 - Xj)xj] . (2) 

Here the wealths after a trade and e a uniform 

random number in (0, 1). Notice that x is conserved dur- 
ing each transactions, X 2 I X j — X , j I X ~ • This dynamics 
closely recalls energy exchange in molecular collisions, an 
analogy noticed by Mandelbrot 14j which becomes closer 
introducing an effective dimension associated to the sys- 
tem: in the homogeneous version of KWEMs, i.e. all 
Xk = X, the equilibrium wealth distribution f(x) is well 
fitted by the energy distribution of a perfect gas in a num- 
ber N of dimensions defined by N{X)/2 = 1 + 3A/[1-A), 
i.e. a T-distribution Jn/2( x ) of order N(X)/2 [15[. In 
fact, inverting N(X), one obtains an average fraction of 
wealth exchanged during one trade 1 — Aocl/A (N^$>1), 
similarly to the energy exchanges during molecular colli- 
sions of an iV-dimensional gas [16| . Then a heterogeneous 
system composed of agents with different Xi is analogous 
to a dimensionally heterogeneous system. The relevance 
of heterogeneous versions of KWEMs with Xi distributed 
in the interval (0, 1) is in the fact that they relax to- 
ward realistic wealth distributions f(x) with a Pareto 
tail, as shown numerically and analytically (l^ |. In the 
case of a uniform distribution for the saving parameters, 



<f>(X) = 1 if A e (0, 1) and 0(A) = otherwise, setting 
n = N/2, the dimension density has a power law ~ 1/n 2 , 
P{n) = 4>{X)dX/dn = 3/(n + 2) 2 (n> 1). 

A dimensionally heterogeneous mechanical model. The 
power law tails of the equilibrium distributions in the 
examples presented above are particular cases of a more 
general mechanism which takes place in dimensionally 
heterogeneous systems. We illustrate it through a simpli- 
fied yet general exactly solvable mechanical model, which 
can be interpreted as an assembly of polymers with differ- 
ent numbers of harmonic degrees of freedom, represent- 
ing e.g. small displacements of its normal modes respect 
to the equilibrium configuration. For simplicity no in- 
teraction term between polymers is included in the total 
energy function, analogously to the statistical mechanical 
treatment of the molecules of a perfect gas. The absence 
of interactions between units implies that each subsys- 
tem undergoes independent statistical fluctuations, while 
a more rigorous treatment of e.g. diffusion on a complex 
network or wealth exchange in the KWEMs considered 
above should take into account the correlations between 
nodes or agents. However, the mechanical model stud- 
ied here below preserves the basic features of the hetero- 
geneous dimensionality and statistical character due to 
internal random fluctuations. 

First, we recall the results for a dimensionally homoge- 
neous systems, e.g. an assembly of identical polymers N 
degrees of freedom (l5| . For a quadratic energy function 
x(q) = (qf H h q%)/2, where the g,'s are the N vari- 
ables of the polymer, the equilibrium density is obtained 
varying respect to f n (x) the functional S n [f n ], obtained 
from the Boltzmann entropy [l5j . 



S n [fn] = J dxf n (x) <{ In 



/(*) 



r n— 1 



+ n + 0x > . (3) 



_ 0~2n X 

Here we have introduced the dimension variable 



n 



= N/2, 



(4) 



o~ 7v is the hypersurface of a unitary iV-dimensional 
sphere, and [i, (3 are Lagrange multipliers determined by 
the constraints on the conservation of the total number 
of subsystems and energy, respectively. The result is a 
T-distribution of order n. 



f n (x) = /3j n (f3x) 



JL 

r(n) 



C&c)™- 1 exp(-0x) . 



(5) 



where /3 _1 = 2(x)/N = (x)/n, according to the equipar- 
tition theorem, is the temperature [l7| . 

A heterogeneous system is composed of polymers with 
different numbers of degrees of freedom N\, iVjj, . . . in con- 
stant proportions Pi, P2, ■ . ■ , with J^Pi = E or, con- 
sidering a continuous dimension variable n = N/2, ac- 
cording to a distribution P(n), with J dnP{n) — 1. At 
equilibrium, each subsystem with dimension variable n 
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will have its probability density f n (x). We are inter- 
ested in the shape of the aggregate equilibrium energy 
distribution, i.e. the relative probability to find a sub- 
system with energy x independently of its dimension n. 
The equilibrium problem for the heterogeneous system is 
solved analogously, from the functional 5[{/„}] obtained 
summing the homogeneous functionals with different n, 



S[{f n }}= dnP(n) 



+ 00 

dx f n (x) 



In 



fnix) 



Oln X" 



+ Hn+(3X 



(6) 

Notice that there is a different Lagrange multiplier \i n 
for each n, since the fractions P(n)'s are conserved sep- 
arately, but a single fi related to the total conserved en- 
ergy. The equilibrium probability density f n (x) for the 
subsystem n is obtained by varying £>[{/„}] respect to 
f n (x) and is again given by Eq. (J5]), with fi determined 
by the total energy, 

(x) = J dn J dx f n (x) x = , (7) 

where we have introduced the average dimension 



(AO 



dn P(n) n . 



(8) 



Equation ([7]) represents a generalized equipartition theo- 
rem for dimensionally heterogeneous systems. To ensure 
a finite (N) (and therefore a finite average energy (x)) 
the dimension density P(n) has to have a finite cutoff or 
decrease faster than 1/n 2 for n^> 1. Using Eq. |(SJ), the 
aggregate distribution is finally 



f(x)= dnP(n)f n (x) 



dn^^iPxr^expi-Px). 
T(n) 

(9) 

While the distributions f n {x) have an exponential tail, 
the function f(x) may exhibit a slower decay and possibly 
a power law tail, if the dimension density P(n) decreases 
slow enough. In the example of the power law density 
P a {n) = a/n 1+a (n > 1, a > 0), P a (n) = otherwise, a 
power law tail appears in /(#), see the continuous curves 
in Fig. [T] obtained by numerical integration. 

In fact, a general result holds, namely an actual equiv- 
alence between the asymptotic form of the aggregate dis- 
tribution f(x) and the dimension density P(n), whenever 
P(n) decreases at large n faster than 1/n, expressed by 
f(x 3> fi~ 1 )—fiP(fix). This asymptotic relation can be 
compared with the equality between the the average load 
and the degree distribution, f(x) — g(x/x)/x, obtained 
for the example of free diffusion on a network with degree 
distribution g(k). 

To demonstrate this relation, we start considering a 
value fix 3> 1 in Eq. ([9|). The main contributions to the 
integral come from values n w fix ^> 1, since 7„(/3x) has 
its maximum at x ~ n/f3, while it goes to zero for small 




FIG. 1: Aggregate distribution f(x), Eq. with P(n) = 
a/n 1+a (n > 1), Pin) = otherwise, for a = 1 (red, dark 
grey), a — 2 (green, bright grey). Continuous lines: numerical 
integration of Eq. <(9j . Triangles: saddle point approximation 
f2(x), Eq. (US}. Circles: small- a; limit, fi(x), Eq. (TT7)l . 



as well as larger x. Introducing the variable m = n 
Eq. (O can be rewritten as 



f(x) — /3exp(— fix) J dm exp[— <j>(m)] , (10) 

<j)(m) = -ln[P(m+l)] -m]n((3x) +ln[T(m+l)] .(11) 

This integral can be estimated through the saddle-point 
approximation expanding cf>(m) to the second order in 
e = m — mo, where too = mo{x) locates the maximum 
of 4>{m), defined by 0'(to o ) = and <f)"(mo) > 0, and 
integrating over the whole range of m, 



f(x) « /3exp[-(3x - (f>(m )} 

= a 



+00 



2tt 



4>"(m ) 



de exp[-^"(TOo)e 2 / 2 ] 
cxp[-/3x - 0(to o )] . (12) 



In order to find too we use the Stirling approximation [l| 
in Eq. (HI]), T(m + 1) w V2ttto (m/e) m , so that 



<p{m) ' 

(b'(n) t 
<t>"(n) 



•ln[P(m+l)] -mla(Px) 



to+— Jln(m) 



+ ln(%/2^) - 

P'(to+1) 
~ P(m + 1) 
P' 2 (m + 1) 
P 2 (m+1) ~ P(to+1) 



TO, 



(13) 



]n(/3x) 



1 

P"(m+1) 1 



2m 2 



ln(m) , (14) 



(15) 



From Eq. (|15p the condition <fi"(m) > for the existence 
of a maximum is fulfilled for large to, if one can neglect 
the terms containing P respect to 1 /to; this can be done 
for general shapes of P(n) which decrease fast enough. 

From Eq. (fT4|) in the same limit one can neglect P'/P 
and 1/to respect to ln(m) and the approximate solution 
of (j>'(mo) = is mo(x) « fix. It can be checked that even 
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keeping higher orders in 1 jm in Eq. (fl4|) the asymptotic 
solution reduces to mo(x) = fix for fix ^> 1. Finally, 
setting m — m (x) — fix and using Eqs. \l'i\ and ([T5]) in 
Eq. HI]), one finds 



/(x»/3- 1 ) =/ 2 (ar) = /3P(l + /3z) 



(16) 



This relation provides the asymptotic form of the density 
fix) directly in terms of the dimension density P(n), in 
the hypothesis that P(n) decreases with n at least as 1/n. 

The approximate form of f(x) at x <C fi^ 1 depends 
on the details of P(n) at small n. For the same form 
P(n) = P a (n) considered above and setting (f>(n) m <fi(l) + 
0'(l)(n - 1) in |101) and dTTJ) , one has 



0'(O)m - /3x] 
(17) 



f{x<^fi- 1 ) = h{x)=fi dmexpH(O)- 
/3P(l)exp(-/3x) 



ln(/3a;) -7- P'(l)/P(l)' 



Here, from Eq. (TTT]), we set 0(0) = ln[P(l)] and 
0'(O) = - 7 - \n{flx) - P'(l)/P(l), with 7 = t/)(l) = 
(dln[r(m)]/dm) m= i « 0.57721 the Euler 7-constant 

In Fig. [T] the function /2(x) (triangles), given by 
Eq. (|16p . is compared at large x with the exact distri- 
bution f(x) obtained by numerical integration of Eq. ([9|) 
(continuous lines) for the values a = 1,2 for the power 
law density P a {n). Also the corresponding density fi(x) 
(circles), given by Eq. ([17)) , is shown at small (3x. 

Conclusion. Canonical statistical mechanics predicts 
that the equilibrium distribution f(x) of a conserved 
quantity x flowing through a system composed of sub- 
systems with different (possibly continuous) dimensions 
n, distributed according to a dimension density P(n), 
can exhibit a robust power law tail. In fact, a general yet 
simple formula holds at large x, which directly relates 
the equilibrium probability density f(x) to the dimen- 
sion density P(n), 



f(x) « fiP(fix) , (x » p- 1 ) 



(18) 



where /3 represents the system temperature. In partic- 
ular, it follows that a dimension density P(n) with a 
power law tail will produce a corresponding power law 
tail in the equilibrium distribution f(x). The mecha- 
nism discussed in this paper may represent a prototype 
model of the effect of a high heterogeneous dimensionality 
on the equilibrium properties of many complex systems, 
such as gene-regulation network models, network-based 
model of language, and kinetic wealth exchange models 
of economy. We have discussed how such a mechanism is 
relevant for diffusion processes across complex networks; 
in the special case of free diffusion on a non-weighted 
network the relation (fT8|) becomes an identity, if f(x) 
is identified with the load distribution, P(n) with the 
degree distribution, and the temperature (3~ 1 with the 
average flux x. Also, the same mechanism is probably 



in action in systems which can be modeled in terms of 
kinetic exchange models, where a set of basic units ex- 
change randomly a conserved quantity x. In the latter 
case, the inverse of the dimension 1/n represents an effec- 
tive interaction strength, since the fraction of quantity x 
exchanged in a pair-wise interaction in a kinetic exchange 
model is of the order of 1/n, as in the case of an energy 
exchange during binary collisions in a fluid in n dimen- 
sions. 
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